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Abstract: We present an experimental demonstration of edge detection 
based on ghost imaging (GI) in the gradient domain. Through modification 
of a random light field, gradient GI (GGI) can directly give the edge of 
an object without needing the original image. As edges of real objects are 
usually sparser than the original objects, the signal-to-noise ratio (SNR) 
of the edge detection result will be dramatically enhanced, especially for 
large-area, high-transmittance objects. In this study, we experimentally 
perform one- and two-dimensional edge detection with a double-slit based 
on GI and GGI. The use of GGI improves the SNR significantly in both 
cases. Gray-scale objects are also studied by the use of simulation. The 
special advantages of GI will make the edge detection based on GGI be 
valuable in real applications. 
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1. Introduction 


Ghost imaging (GJ) is an attractive type of optical imaging that is rather different from tradi- 
tional concepts. In GI, a single-pixel detector is used to detect light from the object, while a 
detector with spatial resolution measures the information about the source [1-3]. The image 
of object is reconstructed by two-order correlation of light intensities on the two detectors. In 
thermal light GI, if the intensity distribution of the source can be determined by calculations 
or predictions, then GI can be performed with only a single-pixel detector [4,5]. Additionally, 
thermal light GI can realize lensless imaging [6,7] and has the ability to weaken the influence 
of disturbance in the light path [8]. Therefore, thermal light GI has been applied in many fields, 
such as lidar detection [9], optical coherence tomography [10], and fluorescence imaging [11]. 

Edge detection, which tests the object edge consisting of a dramatic change in transmittance 
or reflectance of an object, is widely used in target recognition, earth observation and security 
check [12, 13]. In most previous edge detection approaches, the original targets are imaged be- 
fore the edges are extracted with certain algorithms such as differential operator and wavelets 
operator [14, 15]. Although many improved algorithms have been proposed, it is the premise 
of using these techniques to obtain a clear image first [16, 17]. However, in many real applica- 
tion occasions in which turbulence and scattering medium exist, the optical imaging is difficult 
to perform and then the edge detection algorithms cannot be implemented. Owing to the spe- 
cial properties of GI mentioned above, it can solve the problem of disturbance in the imaging 
optical path and will play an important advantage in edge detection. Theoretically, edge de- 
tection based on GI can be achieved with the existing edge extraction algorithms operating on 
the image obtained by GI. However, there is one restriction in practical applications of GI that 
the imaging quality is relatively poor caused by the reconstruction process [18]. If we perform 
edge extraction with image obtained by traditional GI, the quality of edge detection will be 
influenced by the low signal-to-noise ratio (SNR) of the imaging result. 

Many prior studies have focused on improving the imaging quality of GI [18-20], and it is 
concluded that for a fixed sampling number, the SNR of the image will be higher for an object 
with smaller area [21,22]. In the existing GI protocols, the images are generally reconstructed 
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in the original spatial domain, restricting further enhancement of the imaging quality, while 
realizing GI in other domains may be meaningful in real applications [23]. As for most real 
objects the image edges have much higher sparsity than the original images, the SNR of the 
edge detection will be dramatically improved if the object edge can be imaged directly without 
the traditional GI procedure. In this paper, we report a demonstration of gradient GI (GGI) 
that is achieved by modifying the intensity distribution properties of the light source and the 
measurement processing. Edge detection can be realized with GGI needless of retrieving the 
original object. 


2. Theory of edge detection based on gradient ghost imaging 


Modulator Object 


Lens 


Detector 


yb» 


Fig. 1. Schematic diagram of GI. 


The schematic diagram of GI is shown in Fig. 1. The light source is modulated by a rotat- 
ing ground glass or spatial light modulator (SLM) to generate random fields with both spatial 
and temporal fluctuations, which illuminate the object. A single-pixel detector with a collecting 
lens is used to measure the total intensity of light passing through the object. With N ran- 
dom modulations and N corresponding measurements, the distributions of light fields and the 
measurement signals obey the relationship 


Yk = X Ar (xi) T (xi), (1) 


where k denotes the number of modulations, and T (x;) is the transmission function of the 
object. If the field distribution A; (x) is measured or predicted, the image of the object can be 
obtained by a second-order correlation operation [5] 


T (x) =g (A(x),y) = (A()-») — (A) 0), (2) 


where (---) denotes ensemble average. If the measurement number N approaches infinity, 
Eq. (2) will generate an accurate image of the object, but for a finite N, noise exists in the 
resulting image; the SNR can be expressed as [18] 


SNR = ,/ Ye, (3) 


spa 


where Son is the coherence area of the random light field and Sspa = X, 7? (xi) is the spatial area 
of the object. 7 
The edge of an object can be revealed by the parts which have large differences of gray-scales 


with adjacent pixels. Therefore, edge detection can be realized by calculating the gradient of 
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the GI result 
VI (xi) = T (xi) —T (xi41) = 8° (A(x) ,y) 8 (A (i41),9)- (4) 


As the noises in the adjacent two pixels are superposed, the SNR of edge detection will be 
further decreased by a factor of y 2 


N- Scoh 
SNR = , (5) 
Sa 


The object area in real applications could be very large, resulting in low quality of edge 
detection with traditional GI. However, because the grey scales of most real targets will not 
vary violently, a large object in the spatial domain usually has a much smaller area in the 
gradient domain. If we make an image for the gradient of object VT (x) directly, the SNR of 
edge detection will be dramatically improved. It is obvious that we cannot transform the real 
object to the gradient domain, but we can achieve the equivalent effect by modification of the 
sampling process. To realize the imaging of the object edge directly, we replace the random 
light field with random light field pairs, A (x) and B (x), which are related as follows 


B (xi) =A (xi-1). (6) 


Let us assume that N pairs of random light fields illuminate the object, and the total intensities 
passing through the object are detected, producing measurement results ya and yp. We will have 
the following relationships, analogous to that of Eq. (1): 


Xi ~ (7) 


Xi 


With the second-order correlation between the intensity difference Ay = ya — yp and the dis- 
tribution of the random light field A (x;), the object edge can be obtained 


VT (x) = (A (x) Ay) — (A (x)) (Ay). (9) 


In this way, the gradient transform can be operated on the modulated light field instead of the 
real object, realizing edge detection based on GGI. Since the light field interacts with the object 
pixel by pixel, by controlling the distribution of the light field we can achieve an effect equiva- 
lent to that of operating on the object directly, but with greater convenience in real applications. 
Keeping in mind that, in GGI, every valid measurement result Ay is obtained from two modu- 
lated fields, the SNR enhancement of edge detection based on GGI over traditional GI for the 
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same total modulation number is 


Ss a 
n=,/—, (10) 


where Sora = È (VT (x;))* is the area of the object in the gradient domain. 


Xi 


3. Experiments and simulations 
3.1. Experiment of one-dimensional edge detection based on GGI 


The experimental setup for GGI is shown in Fig. 2. A halogen lamp emitting continuous visible 
light with power of 5 mW is used as the source, the collimated light from which is modulated 
by a digital micro-mirror device (DMD) to generate a random light field. The DMD (Texas 
Instruments DLP7000) is a kind of SLM consisting of 1024 x 768 micromirrors each of size 
13.68 um x 13.68 um, which can be controlled individually to reflect light in two directions. 
With a random 0-1 matrix loaded on the DMD, a light pattern with a pre-determined intensity 
distribution will be generated in one reflection direction of the mirrors. Pixels corresponding 
to “1” in the loaded matrix will produce bright speckles and the opposites correspond to dark 
speckles in the light pattern, which is then imaged by Lens2 with a focal length of 50 mm 
onto the observed object at a magnification of 1.3. By this means, a light field with the required 
properties can be generated conveniently. Light passing through the object is collected by Lens3 
with focal length of 50 mm to be detected by a charge coupled device (CCD) (AVT Manta G- 
145B). The intensities of all pixels are added to obtain a total value, so the CCD is used as a 
single-pixel detector without invoking its spatial resolution capability. 


Lens 1 
Source M 


Fig. 2. Experimental setup for edge detection based on GGI. BS, beamsplitter. DMD, digital 
micro-mirror device. CCD, charge coupled device. The source is a halogen lamp, and Lens1 
is used for collimation. 


We first verify the effectiveness of edge detection based on GGI in one-dimension, using 
a double-slit as the test object. As shown in Fig. 3(a), the slit width is 0.5 mm and the slit 
separation is 1.0 mm. To realize one-dimensional imaging, the generated light fields have ran- 
dom fluctuations with the spatial coherence length Scoh of one DMD pixel which is 17.8 um 
along the direction of the double-slit, while maintaining uniformity along the direction of the 
slit height. With 1200 random modulations the traditional GI image is obtained, as shown in 
Fig. 3(b), and edge detection is performed with Eq. (4) and shown in Fig. 3(c), the SNR of 
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Fig. 3. Experimental results of one-dimensional edge detection based on GGI. (a) Original 
object image. (b) GI result in spatial domain. (c), (d) are the results of edge detection based 
on GI and GGI, respectively. The figures are normalized to a range of -1~1. 


which is 3.32, as determined from the following definition 


__ mean (Teige) — mean (Jpack) 
(var (Joack))? 


where Iedge and Jpack are the intensities of the edge detection result in the object edge and 
background region respectively, and var stands for the variance. The SNR is not very high as 
the transparent length of the double-slit Sspa is 1.0 mm, much larger than Soon. However, the 
gradient image of the object is quite simple, as there are nonzero values only at the edges of the 
slits, the length of which is ideally only 4 pixels, i.e., 4 times the coherence length. However, in 
the actual situation it is difficult to overlap the object with pixels of field modulation accurately, 
making each edge occupy 2 pixels; hence, the actual length in the gradient domain is about 
Sora = 8Scon = 142 um. To realize edge detection based on GGI, 600 random light field pairs 
obeying the relationship of Eq. (6) are generated, maintaining the total measurement number 
equal to that of the traditional GI. Figure 3(d) shows the result of GGI, the SNR of which is 
8.02. It is obvious that the edges of the object can be clearly distinguished with high SNR. The 
SNR enhancement factor is 2.42, which is consistent with the theoretical prediction in Eq. (10) 
of n = 2.65. 


(11) 


3.2. Experiment of two-dimensional edge detection based on GGI 


For a two-dimensional object, we define the object edge or gradient image as 


; n 
VT (xyi) =T (x y;) — T (titm Y jtn), With = arctan ( >), (12) 
where m, n are integers and @ indicates the angle between the gradient vector and the x-axis. 
Just as in the one-dimensional situation, to realize edge detection based on GGI we need the 
random light field pairs A (x) and B (x) to satisfy the relationship: 


B (xiy) =A iim Yj-n)- (13) 


In this way, the edge of object for both the x-direction and the y-direction can be imaged. In 
fact, Eq. (6) for one-dimensional edge detection is just a special case in which m = 1 and n = 0. 

We use the same double-slit mentioned above to illustrate the implementation of two- 
dimensional edge detection, and the slit heights are 1.07 mm. We chose m = 1 and n = 1 to 
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Fig. 4. Experimental results of two-dimensional edge detection based on GGI. (a) Original 
object image. (b) GI result in spatial domain. (c), (d) are the results of edge detection based 
on GI and GGI, respectively. In (b), (c) and (d), the object edges are shown as absolute 
values. The size of one pixel is 35.6 um x 35.6 um. 


realize GGI with a gradient vector of @ = 45°, and every 2 x 2 micromirrors in the DMD are 
modulated as a whole so that the spatial coherence length of the modulated field is 35.6 um. 
Figure 4(a) shows the original image in the space domain with area of 1 mm?. The edge of the 
double-slit is two rectangular boundaries and the area can be calculated as 0.22 mm?. There- 
fore, the theoretical SNR enhancement of GGI is n = 2.13. To achieve traditional GI, 3600 
random light fields are used and the obtained image is shown in Fig. 4(b). With processing in 
Eq. (4) the result of edge detection is given in Fig. 4(c) with a SNR of only 1.27. To perform 
edge detection based on GGI, 1800 pairs of random fields are generated according to Eq. (13), 
and the imaging result of the object edge is shown in Fig. 4(d) with the SNR increased to 2.57. 
The experimental SNR enhancement factor of GGI is 2.02, slightly less than the theoretical 
value mainly due to the inaccurate overlapping of the object and the modulation pixels. 


3.3. Role of GGI in SNR enhancement of edge detection 


The implementation of GGI plays an important role in the SNR enhancement of edge detection. 
From Eq. (10), the SNR enhancement is related to the factor of Spa / Sgra. In general, for a two- 
dimensional object, the transparent area increases with the square of the object length, while 
the area of object edge is proportional to the length of the object because the edge is composed 
of one-dimensional lines. Therefore, for a larger object, the object area in the gradient domain 
Sgra increases more slowly than the spatial area Sspa, causing the edge detection quality to be 
improved more significantly. We use simulations to study the edge detection quality improve- 
ment of GGI for different object areas. The test object is shown in Fig. 5(a); its size is varied 
from 100 to 1000 pixels in 100-pixel steps, and the spatial coherence length of the field is 1 
pixel. The edge of original object is shown in Fig. 5(b). With the same measurement number of 
10,000, the edge detections of objects with different areas are performed by traditional GI and 
GGI, and the SNRs of results are calculated. Figure 5(c) shows the SNRs of edge detections 
with GI and GGI as functions of object size l. SNR1 is for traditional GI with curve fitting 


to SNR1 = afl, and SNR2 is for GGI with curve fitting to SNR2 = B/vi in which a, B 
are fitting parameters. We can see that the simulation results (data points) agree very closely 
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Fig. 5. SNR of edge detections based on GI and GGI. (a) Original object. (b) Object edge. 
(c) SNR1, SNR2 are the SNRs of edge detections based on GI and GGI, respectively, for 
different object sizes. (d) SNR enhancement versus object size. Data points are simulation 
results and dashed curves are fitted according to the theory. 


with the theory (dashed curves). The SNR of edge detection with GGI remains larger than that 
with GI, and decreases more slowly when the object size increases. Figure 5(d) plots the SNR 
enhancement factor (data points) versus the object size. From the curve fitting (dashed curves) 
the factor is proved to be proportional to the square root of /. In our experiments shown in 
Fig. 3 and Fig. 4, we use objects with small areas to reduce the imaging time, resulting in SNR 
enhancement that is not very high; however, for large objects, GGI will produce more dramatic 
improvements in the quality of edge detection. 


3.4. Edge detection of gray-scale objects 


Edge detection based on GGI is applicable not only to black and white objects but also to gray- 
scale objects. The gray-scale object used in our simulation is shown in Fig. 6(a) with the gray 
scales marked on each part. The object size is 500 x 500 pixels. With 50,000 random light fields 
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the GI result is shown in Fig. 6(b). With definition in Eq. (12) and parameters set to m = 1 and 
n= 1, edge detection with a gradient vector of 45° is realized, as shown in Fig. 6(c). With m = 1 
and n = —1, edge detection with a gradient vector of —45° is obtained in Fig. 6(d). The SNRs 
are only 0.80 and 0.60, respectively, and the boundaries of the different parts are completely 
unable to be distinguished. The results of edge detection based on GGI are shown in Fig. 6(e) 
and 6(f) with gradient vector of 45° and —45°, respectively. The SNRs are increased to 8.43 
and 7.37, which are about 10 times that of traditional GI since the object area is very large. The 
average values of the boundaries are marked in the figures; their proportions are very consistent 
with the gray scale differences. With different parameters, GGI can give information about the 
gray scales of object edges in different directions accurately. For a high transmittance object, 
edge detection with GGI will not be affected by the large-area uniformly transparent parts, 
which is a great advantage compared with traditional GI. 


(c) 


Fig. 6. Edge detection with gray-scale object. (a) Object. (b) Traditional GI result. (c, d) 
Edge detection based on GI with 45° and —45° gradient vectors, respectively. (e, f) Edge 
detection based on GGI with 45° and —45° gradient vector. Gradient vectors are marked in 
the figures. 


4. Discussions and conclusions 


Our method of edge detection based on GGI can directly obtain the edge information of objects 
with point detection. This is physically different from traditional edge detection techniques 
which make image processing on the original object images. The information acquisition mode 
of GGI brings several benefits to edge detection. First, in GGI we just detect the total intensity 
of light from the objects without spatial resolution, which avoids the disturbance of imaging 
optical path on the light intensity distribution and therefore can be used in the turbulence and 
scattering environments. Second, as differential operation and wavelets transform are usually 
sensitive to the noise, the effect of traditional methods of edge detection is closely related to the 
quality of the object image [24]. Noise on any one pixel of the image may induce an error in the 
result of the edge extraction. Although filters can be used in the image processing to suppress 
the noise, it will blur the edges at the same time. While in GGI, every single time of detection 
is a global measurement on the object. According to Eq. (7-9), the noise in the measurement 
result Ay generates effect on the whole reconstructed image but not a local position, which will 
not induce serious errors in the edge detection. Therefore, the edge detection based on GGI has 
good robustness against the measurement noise. 
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In conclusion, we have experimentally demonstrated edge detection based on traditional GI 
and GGI. By modifying the properties of the light source and the processing of the information 
measurement, GI is performed in the gradient domain and the edge of an object can be directly 
obtained without imaging the original object, achieving high SNR in the edge detection result. 
The implementation of GGI has particular advantages for large-area, high-transmittance ob- 
jects. Moreover, the modification of light field provides a method to expand GI technique to 
other domains. As GI has the ability of lensless imaging and weakening the influence of turbu- 
lence, we believe that edge detection based on GGI will be valuable in many real applications 
such as earth observation and security check. 
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